Python Job: Senior Data Engineer

Job added on

Company

landing.jobs

Location

Porto - Portugal

Job type

Full-Time

Python Job Details

SKILLS

Must have:

Apache Hive

Apache Hadoop

Python

Other Required:

Kubernetes

Apache Spark

Apache NiFi

Apache Kafka

Apache Airflow

SQL

Nice to have:

E-commerce

Kanban

Scrum

DESCRIPTION

  • Contribute in the design and construction of the company data lake;
  • Collect, store, process, and support the analysis of huge sets of data, both structured, semi-structured and unstructured.
REQUIREMENTS

  • Experience creating and driving large scale ELT pipelines (Airflow, NiFi, Spark);
  • Demonstrable skills and experience using SQL with large data sets (Hive, SQL Server, etc);
  • Experience with object-oriented/object function scripting languages: Python, Java, C#, etc.
  • Knowledge of Kafka data streaming;
  • Build analytics and data visualization tools that utilize the data pipeline to provide actionable insights (Superset, Power BI, etc)
  • Experience with high throughput, 24x7 systems;
  • Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations;
  • Experience supporting and working with cross-functional teams in a dynamic environment.
PERKS

We offer you a career with
  • A unique experience in an entrepreneurial, yet structured environment
  • The opportunity to become part of a highly professional and dynamic team working around the world
  • An unparalleled personal and professional growth as our longer-term objective is to train the next generation of leaders for our future internet ventures

And even more for our Jumees
  • Attractive bonus scheme
  • Free access to Udemy for Business for an unlimited training experience
  • A great work-life balance: hybrid work week; additional vacation day in December
  • Caring perks: individual private health insurance, dental insurance, discounted gym membership, parental bonus
  • Fun at work: company events, quarterly team building, drinks and snacks.